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ABSTRACT 



A printed book has associated therewith certain electroni- 
cally stored data in the form of images, sounds and/or 
supplemental text. Visual cues are provided to the reader of 
the book in the vicinity of text having associated electroni- 
cally stored data. The electronic data is preferably stored in 
a remotely accessible server. A graphical user interface is 
provided for controlling access to the data stored in the 
server. When the reader of the book wishes to access data 
associated with a portion of the text, the reader uses a 
computer pointing device to select or manipulate indicia on 
the graphical user interface corresponding to the visual cue 
in the book. The server retrieves the appropriate data which 
is then presented to the reader as images, sounds and/or 
supplemental text on the reader's computer, thereby provid- 
ing a multimedia enhanced reading experience. 

15 Claims, 1 Drawing Sheet 
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PRINTED BOOK AUGMENTED WITH indicia may be identically the same or may be sufficiently 

ASSOCIATED ELECTRONIC DATA similar so that the reader can unambiguously identify a 

symbol or icon on the computer screen that corresponds to 

BACKGROUND OF THE INVENTION the symbol or icon appearing in the book. The reader 

1 Field of the Invention 5 desi S Dates or manipulates the graphic indicia appearing on 

the computer screen using a computer mouse or similar 

The present invention relates generally to the field of pointing device. The server then retrieves the data associated 

multimedia publishing. More particularly, the invention per- ^ the mdicia and presents the data to the reader as images, 

tains to a printed book, the text of which is augmented with sounds and/or supplemental text on the reader's computer, 

associated electronic data stored in a remotely accessible 10 Alternatively, the reader may be presented with a menu or 

server - other secondary graphical user interface to select images, 

2. Prior Art sounds and/or text for presentation. 
As the home computer has matured, there has been a 

veritable explosion in "multimedia publishing". Avast array BRIEF DESCRIPTION OF THE DRAWINGS 

of software titles are now available to the computer owner is pjQ X illustrates a book printed in accordance with the 

which combine text, images and sounds to provide a mul- present invention 

timedia experience. Widespread penetration of CD-ROM ™« * ■„ , . , 

drives into home computers has accelerated this process. FIG : 2 1 '" strates a 8 ra P h,cal "?* f erface f°"etnevmg 

Multimedia content is also available via the Internet, par- 'exl-related data in accordance with the present invention, 

ticularly the World Wide Web. 20 DETAILED DESCRIPTION OF THE 

The public's enthusiasm for computer-based multimedia INVENTION 
experiences is seen by many as a threat to more conventional 

forms of publishing, particularly book publishing. In the following description, for purposes of explanation 

Nevertheless, the experience of reading a book cannot be and not limitation, specific details are set forth in order to 

duplicated with electronic media and reading remains a 25 provide a thorough understanding of the present invention, 

pleasurable pastime for a great many persons, whether or not However, it will be apparent to one skilled in the art that the 

they also engage in computer-based entertainment, present invention may be practiced in other embodiments 

There have been several approaches to combining that de P arl from these specific details. In other instances, 

computer-based multimedia experiences with a separate m detailed descriptions of well-known methods and devices 

printed text. One particular approach relates to training and 30 are omitted so as t0 not obscure the description of the present 

educational subjects where a printed course book is provided invention with unnecessary detail. 

in combination with multimedia content stored locally on a FIG. 1 shows a book 10 printed in accordance with the 

hard disk, floppy disk or CD-ROM, or remotely accessible present invention. Book 10 is essentially like an ordinary 

via the Internet. While the course book and multimedia book, having a plurality of pages 12 containing printed text, 

materials may parallel one another, a reader of the course Book 10 may be a work of fiction or non-fiction. The subject 

book is not provided with any graphic indicia that will direct matter of book 10 is not particularly relevant to the present 

his or her attention to electronically stored data associated invention, it being understood that the invention can be 

with the text being read at the time. advantageously applied to virtually any type of book. 

U.S. Pat. Nos. 5,597,307 and 5,624,265 to Redford, et al. 40 I" addition to the normal printed text, book 10 is 

disclose a printed publication having associated electronic imprinted with graphic indicia 14 on at least one of pages 12. 

content. The printed publication contains one or more but- Indicia 14 appears in the immediate vicinity of text for 

tons which actuate a remote control transmitter within the which there is associated electronically stored data available 

book. A remote control receiver is coupled to the reader's for retrieval by the book reader. Indicia 14 may take many 

home computer system. Upon receipt of a remote control 45 forms. For example, it may be a symbol or icon appearing 

signal, electronic content associated with the text of the in or near the margin of the page. The symbol or icon may 

publication is downloaded from a remote server and pre- be thematically related to the subject matter of the book, but 

sented to the reader on the home computer system. Apart this is not necessarily the case. An example of such a 

from pressing the button in the printed publication, the thematic relationship would be the use of a compass rose in 

reader does not participate in the interface between the home 50 a book related to exploration. If indicia 14 appears on a 

computer system and the remote server. This necessarily number of pages of book 10, each appearance of the indicia 

limits the interactivity of the interface, may be the same or slightly different. For example, a 

compass rose could be used with a pointer that points in a 

SUMMARY OF THE INVENTION different direction for each appearance of the indicia. This 

Hie present invention provides a system and method for ss can then b , e used * direct *e reader to the appropriate 

augmenting a printed text with electronically stored data in electronically stored data as explained below, 

the form of images, sounds and/or supplemental text. A Indicia 14 may be integrated with the text of the book. For 

printed book contains a plurality of pages of text. At least example, one or more words of the text or the page number 

one of the pages is imprinted with a first graphic indicia, may be printed in boldface type or in a contrasting font or 

such as a symbol or icon. Data associated with the text 60 color - It is merely necessary that indicia 14 be readily 

appearing on that page is preferably stored in a remotely apparent to the reader of book 10, but is preferably of a 

accessible electronic data server. The server may be nature that it will not cause the reader undue distraction, 

accessed from a client computer belonging to the reader of As indicated above, indicia 14 provides a visual cue to the 

the book. A graphical user interface is provided for control- reader that there is electronically stored data associated with 

ling the access to data stored in the server. The graphical user 65 the text in the vicinity of the indicia. Such data may be in the 

interface displays second graphic indicia that is visually form of images, sounds, and/or supplemental text. Image 

correlated with the first graphic indicia. The two graphic data may comprise maps or photographs showing locales 
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referred to in the text, photographs or illustrations of char- 
acters referred to in the text, etc. Sound data may comprise 
narrations of the text, sound effects associated with events 
portrayed in the text, mood setting music, etc. Supplemental 
text data may comprise "sidebars" relating to the text, 
alternative accounts of events portrayed in the text, 
unabridged accounts of a condensed text, etc. 

Certain types of supplemental text data are unique to the 
present invention. One example is a "running" synopsis. At 
various points throughout the printed text, the reader may be 
prompted to obtain an electronically stored synopsis of the 
story told up to that point. No information is revealed 
concerning events that take place beyond the page where the 
reader accesses the electronically stored data. The synopsis 
may include the cast of characters introduced thus far, a 
chronology of events or various other summaries. The reader 
need not be prompted with graphic indicia to utilize this 
feature. The electronically stored synopsis may be arranged 
to be accessed at any corresponding point within the printed 
text. This can be accomplished by simply entering the page 
number of the printed text following an appropriate prompt 
in the user interface. 

Referring next to FIG. 2, the image, sound and/or supple- 
mental text data associated with portions of text in book 10 
are stored in a data storage device such as a remote data 
server 20; however, the invention is not limited in this 
regard. The data storage device may be local to the client 
computer in the form of a hard disk, floppy disk, CD-ROM 
or other data storage medium. In the presently preferred 
embodiment utilizing remote data server 20, remote access 30 
to the server is preferably provided via the World Wide Web. 
A client computer 30 belonging to the reader of book 10 
comprises a processor unit 32, display 34, keyboard 36 and 
a mouse or equivalent pointing device 38. 

To access the data stored in server 20, the reader must first 
log on to the server. This is accomplished in a conventional 
manner, but may require validation to ensure that the person 
logging on possesses a copy of book 10. Such validation 
may be accomplished by, for example, entering a serial 



different direction. The reader would then select indicia 40 
on the web page and, using pointing device 38, would rotate 
the pointer to the proper orientation. Alternatively, indicia 40 
may have a "pull-down" menu of various page numbers 
corresponding to the page numbers in book 10 on which 
indicia 14 appears. 

It will be recognized that the above described invention 
may be embodied in other specific forms without departing 
from the spirit or essential characteristics of the disclosure. 
Thus, it is understood that the invention is not to be limited 
by the foregoing illustrative details, but rather is to be 
defined by the appended claims. 
What is claimed is: 

1. A method for augmenting a printed text with electroni- 
cs cally stored data comprising the steps of: 

providing a printed book containing a plurality of pages of 
text, at least one of the plurality of pages having a first 
graphic indicia printed thereon: 
providing a data storage device storing data associated 

with the text on said one of the plurality of pages; 
providing a graphical user interface for accessing said 
data storage device with a computer, said graphical user 
interface displaying second graphic indicia visually 
correlated with the first graphic indicia; 
designating said second graphic indicia with a pointing 
device; 

retrieving said data stored in the data storage device; 
presenting said data on said computer; 
wherein the data stored in the data storage device com- 
prises a synopsis of the pages of text preceding said one 
of the plurality of pages. 

2. The method of claim 1 wherein the data storage device 
is accessed remotely from the computer. 

3. The method of claim 2 wherein the data storage device 
is a data server. 

4. The method of claim 3 wherein the data server is 
accessed via the World Wide Web. 

5. A method for augmenting a printed text with electroni- 
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number printed on book 10. Once the reader has successfully 40 cally stored data comprising the steps of: 



logged on, a graphical user interface is presented on display 
34. This interface is preferably constructed as a web page 
using conventional programming techniques. A variety of 
web pages, each associated with a particular book title, are 
preferably provided by server 20. The web page for book 10 45 
includes graphic indicia 40 that are visually correlated with 
the graphic indicia 14 appearing in book 10. To retrieve the 
data associated with the text in the vicinity of indicia 14, the 
reader uses pointing device 38 to select indicia 40. Such 
selection may be accomplished by "clicking on" indicia 40, 
and may include or be followed by manipulation of the 
indicia as described below. The reader's actions with respect 
to indicia 40 are communicated to server 20 which retrieves 
the associated data and transmits it to processor unit 32. The 
data is presented to the reader by computer system 30 in the 
form of images, sounds and/or supplemental text. 

It is not necessary that indicia 40 be identical to indicia 14, 
as long as there is a sufficient visual correlation between the 
two that the reader can unambiguously select the appropriate 
indicia. If every appearance of indicia in book 10 is a unique 
symbol or icon, corresponding symbols or icons are pro- 
vided on the web page. Alternatively, a commonly formatted 
symbol or icon may be used throughout book 10. In this 
case, the web page would be constructed so that indicia 40 
leads the reader to further selection options. For example, if 65 
indicia 14 is in the form of a compass rose, each appearance 
of indicia 14 in book 10 may have a pointer pointed in a 
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providing a printed book containing a plurality of pages of 
text, at least one of the plurality of pages having a first 
graphic indicia printed thereon: 

providing a data storage device storing data associated 
with the text on said one of the plurality of pages; 

providing a graphical user interface for accessing said 
data storage device with a computer, said graphical user 
interface displaying second graphic indicia visually 
correlated with the first graphic indicia; 

designating said second graphic indicia with a pointing 
device; 

modifying a feature of said second graphic indicia with 

said pointing device; 
retrieving said data stored in the data storage device; 
presenting said data on said computer. 

6. The method of claim 5 wherein said feature of said 
second graphic indicia is modified to match a corresponding 
feature of said first graphic indicia. 

7. The method of claim 5 wherein said feature of said 
second graphic indicia comprises a pull-down menu, 

8. An information delivery system comprising: 

a printed book containing a plurality of pages of text, at 
least one of the plurality of pages having a first graphic 
indicia printed thereon; 

a data storage device storing data associated with the text 
on said one of the plurality of pages; 
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a graphical user interface for accessing said data with a 
computer said graphical user interface displaying sec- 
ond graphic indicia visually correlated with the first 
graphic indicia; 

means for designating said second graphic indicia; 

means for retrieving said data stored in the data storage 
device; 

means for presenting said data on said computer; 

wherein the data stored in the data storage device com- 
prises a synopsis of the pages of text preceding said one . 
of the plurality of pages. 

9. The information delivery system of claim 8 wherein the 
data storage device is accessed remotely from the computer. 

10. The information delivery system of claim 9 wherein 
the data storage device is a data server. 

11. The information delivery system of claim 10 wherein 
the data server is accessed via the World Wide Web. 

12. A multimedia information system comprising: 
a printed book containing sequential information; 



a data storage device storing a cumulative summary of 
said sequential information; 

means for accessing said data storage device and for 
5 designating a location within said printed book; 

means for displaying said cumulative summary of the 
sequential information up to said designated location 
within the printed book, but no further. 

13. The multimedia information system of claim 12 
10 wherein said cumulative summary comprises a synopsis of 

the sequential information. 

14. The multimedia information system of claim 12 
wherein said cumulative summary comprises a cast of 

5 characters introduced in the sequential information. 

15. The multimedia information system of claim 12 
wherein said cumulative summary comprises a chronology 
of events occurring in the sequential information. 
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